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Overview 


Three Themes 


- Ongoing need for human engagement with 
autonomy 


- Not designing autonomous systems to interact 
with humans increases costs 


- Ata system level, autonomy coupled with human 
intelligence will remain superior to either on its 
own 


Machine Intelligence 


We appear to be at an exciting time with respect intelligent 
machines (again). 


¢ Four Related Areas of Development 
1. Big Data - volume, velocity and variety 
2. Deep Learning 
3. Networked operations and cyber-physical systems 


4. Moore’s Law (exponential growth, doubling of components on an integrated circuit 
every two years): faster, bigger computers driving change with increasing velocity 


¢ Stephen Hawking, Bill Gates and Elon Musk have all recently 
warned about the potential dangers of Al. 


¢ Also interesting time in terms of self-driving cars and 
companies with robotic operations/factories like Amazon, Tesla 
and Toyota 


¢ Big Blue, Watson, Pokerbot 
¢ Google DeepMind Al Division beats human at GO (Jan 2016) 
¢ First Al investment software hits Wall St. (Feb 2016) 
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PROGRESS 
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Progress in Artificial Intelligence 


2005 


2010 


2015 


Weak Al 
Pattern analysis, 
image recognition 
(e.g., NLP, SDCs, 
Go, Watson) 


Strong Al 
Adaptive problem 
solving, reasoning, 
generalizable 
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UPDATED: Littoral Combat Ship USS Montgomery 


Suffers Engineering Casualty, Fifth LCS Casualty 


The Littoral Combat Ship “"""*?5* ¥°7" 


¢ New, highly autonomous 
vehicle 


By: Sam LaGrone 
September 16, 2016 12:26 PM * Updated: September 16, 2016 10:52 PM 


In the end, the ship required 60 
sailors, all E5 or above 


US Navy Orders Engineering Stand Down, ... and they are still encountering 


Retraining for LCS st des 
By: Christopher P. Cavas, September 5, 2016 /r rede: US Navy major ISSUES 


Manpower Reduction: 
start with the Human (Not the Technology) 


The Autonomy Paradox 


(Blackhurst, Gresham & Stone, 2011) 


¢ Autonomy doesn’t get rid of 
humans, it changes their roles 


¢ DoD has shifted from Levels-of- 
Automation to Cognitive Echelons 


As machine intelligence advances, the The Littoral Combat Ship 
need for better human interfaces 


Built to be operated by 45 sailors 
increases 


Dr. Larry Shattuck, NPS (pg. 13-15) 
http://human-factors.arc .nasa.gov/workshop/autonomy/download/presentations/Shaddock %20 .pdf 
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Knowledge 


Relative strengths of computer vs. human information processing 


From Cummings, M.L.," 


Expertise 


Uncertainty 


Humans 


" IEEE Intelligent Systems, (2014) 29(5), p. 62-69. 


e.g, Current HITL 
for ATM Next-Gen 
research 


2035 


Adaptive Expertise 


Knowledge 


Uncertainty 


Skills 


Relative strengths of computer vs. human information processing 


Architecture based on autonomy performing all skill and rule-based roles, as well as most knowledge-based roles. 
Manpower reduced by two orders of magnitude with remaining expert humans teaming with machine intelligence to 
solve complex problem solving under uncertainty. Machine intelligence for airspace management evolves from the 
outset to support teaming with small set of expert humans to support cooperative problem-solving. 


What are the Challenges of 
Working with Autonomy? 


¢ Lack of transparency about intent, state awareness, 
risk/confidence posture, graceful degradation, etc. 


¢ Part of the challenge is just the reverse though. Given 
that the Autonomy does not know what the human is 
trying to do, it is difficult for the system to know to 
engage in ways that are useful. 


Toward Human- 
Autonomy 
Teaming? 
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Domesticated Robots 
aan 


ce) es @ >) Ames Research Center NASA 


Path to Collaborative, Human-in-the-Loop Planning Systems 


Mars Rovers 


ISS 
MSLICE/s, ® o> 
Mars Science Laboratory Interface G/ 
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LADEE Acimity Scheduling Systern 
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Science Interface 


Phoenix Lander Playbook 


e>) Ames Research Center 


Crew at Splashdown 


wasal Daily Status: Mission Day 1 


Playbook 

For this mission, our plan execution tool is Playbook, which is developed by NASA Ames 
Research Center and specifically designed for use by crew to support mission 
operations, it is mobile, web-based, and designed to be flexible enough to work on a 
tablet device or in a traditional web browser. Used as the primary mission operations 
tool, Playbook allows controllers and crew to see the mission plan and schedule changes 
in real-time or through fully simulated time-delay. New features under evaluation include 
one that makes it very easy for the crew to collaboratively self-schedule flexible tasks, 
create new tasks, add groups of tasks to the timeline and keep the ground informed as 
they do so. We have a number of objectives related to crew self-scheduling we will be 
looking at, and crew feedback will continue to make this tool even more capable. There 
is also a new feature giving the ability to search all messages in real time, to allow 
mission control and the crew to easily refer back to past messages or to see all 
messages in a related thread. 


1 1 1 1 Playbook pr flew on ISS in ob i f the IRISS mission of Andr 
NASA Extreme Envi ronments Mission Operations siepensen ts Gapl. 2098. will ane cctis cule amesneat aUPP an aiaeaiied 
(NEEMO): Underwater laboratory off of the coast of Key Saeane akin hat Wencaeeeenadaenedantaeeee 


Largo, Florida. 


International Space Station 


CAST — Crew Autonomous Scheduling 
Test: 


¢ Playbook Check-Out by Scott Kelly on 
Station in August 2015. 


¢ Astronaut Peggy Whitson trained on 
Playbook in July 2016. 


o) ieee 86° §=©6Astronaut self-scheduling study on ISS on 
Mission Increment 50/51 Nov 2016. 


ISS Mission Control 


¢ Three integrated planning 
systems: Power, Attitude 
Control and Crew Activity 


* Crew activity includes ESA 
JAXA and Payloads 


Ames Research Center wha 


¢ Application of Gibsons’ 
Ecological Psychology 


¢ Alternatives to using 
human central attention 
resource 


¢ Acar more like a horse 


Characterizing calorie burn during swimming and using learning algorithms 
to tune the functionality to individual differences 


Developed novel experimental hardware and tested on 700 swimmers 


To develop a feature on one app for the new iWatch 


Commands 


Automation 
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Increasingly 
Autonomous 
System 
Human 
Autonomy 
Teaming 


Human/Machine Interface 
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From SECAT briefing package, Aponsonet al., 09/2016 
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Aircraft 


Aircraft State 


\ System 
Faults 


eather 


J & Traffic 


_ “ATC Clearances 


Pp 


Airspace is a 
complex system 
and complexity will 
only continue to 
increase 


Humans are both 
limiting and 
enabling parts of 
system (pilots have 
to address 
unexpected safety 
issues on 20% if 
flights*) 

DoD > $3B on H/A 
Teaming in FY17 


* 
From NTSB Asiana 214 Docket 


The Economics of Human-Centered Automation 


Purpose 


- For lower costs, higher Advancement of autonomous systems, and 


identification of potential investments to advance or 


effi Cc ; e n Cc ; es a n d ove ra I l initiate critical enabling technology development. 
. What’s driving Autonomy S&T? 
[ Mm p roved syste mM * Manpower efficiencies | 
reduce human footprint and personne! cost 
* Rapid response and 24/7 presence 


pe rfo r Mm a Nn ce timely, persistent, enduring 


* Harsh environments 
day, night, hot, cold, weather, rubble 


: Characterize nature of human roles * New mission requirements 
; ‘ increasing competence, new capabilities 
(skills, rules, knowledge, expertise) * Advanced medical applications 
pi critical response, end-to-end critical care 
and tasks (e.g., proportion of hard + Logistical support 


reduce logistics burden 


and soft constraints) 1 


CO! Sub-Areas ($M) 


WhHuman & Autonomous 
interaction and Collaboration 


¢ Wrap autonomy around remaining 
human roles from the beginning 


mw Machine Perception 
Reasoning. intelligence 


mw Scalable Teaming of 
Autonomous Systems 


@ Testing, Evaiuation, V&V 


Critical to shape the autonomy industry 
° eg., Apple v. Littoral Combat Ship 


Total=$149M 


Dr. Jon Bornstein, DoD Autonomy Roadmap Autonomy Community of Interest 
http://www.defenseinnovationmarketplace .mil/resources/AutonomyCOINDIA_Briefing20150319.pdf 


Teaming of Human and Machine Intelligence 


¢ Even as computers get very “intelligent”, it is very likely that the nature 
of the their intelligence will be different than that of humans (unless they 
become omniscient or we program them to function just like humans) 


¢ Humans are particularly good at adaptive problem-solving and discovery, 
areas where there has been little machine intelligence progress 


¢ Successful efforts going forward will be those that wrap new machine 
intelligence capabilities around human competencies in order to get the 
most out of each 

Goal: Design the human into the process. Focus on how 

the system will communicate it’s state to the human so 

that the human can help in un-anticipated situations, and 

vice versa. 


What data and how it is presented to each agent such that each can bring 
its unique capabilities to bear on it. 


Final Thoughts 


¢ Humans will remain important components of complex 
systems 


¢ Use human adaptive expertise as much as possible 


¢ Use human cognitive & perceptual system as much as 
possible in interactions 


¢ Robotics progressing faster than Al 


¢ Be aware of areas where you don’t have big data 
Not all problems are associative in nature 


¢ Don’t assume search will solve all problems 


